Numerical Simulations of Finite Dimensional Spin Glasses Show 

a Mean Field like Behavior 

E Marinari* 
September 10, 1997 

Abstract 

I discuss results from numerical simulations of finite dimensional spin glass models, and show 
that they show all signatures of a mean field like behavior, basically coinciding with the one of the 
Parisi solution. I discuss the Binder cumulant, the probability distribution of the order parameter, 
the non self-averaging behavior. The determination of correlation function and of spatially blocked 
observables quantities helps in qualifying the behavior of the system. 

1 Introduction 

In the following I will try to introduce the main results that come from numerical simulations of 
finite dimensional spin glass models. In this short report I will just try to summarize the main 
ideas, the crucial points and their implications. The reader is referred to the original papers for 
details. The recent review jllI] is a detailed summary of the history of numerical simulations in 
the field. References ^ ^ establish and qualify the existence of a phase transition in the 3 
dimensional model. Reference Q discusses about ultrametricity in the finite dimensional models, 
while ^ discuss about the existence of a transition in field. Reference H discusses in detail about 
the probability distribution of the overlap in 3 dimensional models, while ||9| and are respectively 
accurate simulations of the 3 and of the 4 dimensional model. Improved Monte Carlo methods like 
tempering, that turn out to be crucial in allowing interesting numerical simulations of the disordered 
phase of spin glasses, are discussed in These numerical results can be a good support in the 

rigorous approach to models with quenched disorder jl2j that has been recently moving the first 
steps. 

We are interested in models with quenched disorder. The Hamiltonian H = ~ aiJijaj, where 
(Ti = ±1, the indices i and j take values on a D dimensional lattice of linear size L (typically with 
periodic boundary conditions) , and the primed sum is over first neighboring site couples on a simple 
cubic lattice. The realistic Edwards-Anderson model is defined in 3-D (even if, as we will see in the 
following, we are mainly interested in the generic behavior of finite dimensional models, as opposed 
to the infinite dimensional mean field approximation, and sometimes we will prefer to study the 4D 
model, not to be mislead by the additional difficulties that the vicinity of D = 3 to the lower critical 
dimension of the model can introduce). The couplings J are quenched random variables: they can, 
for example, take the value ±1 with probability one half, or be Gaussian, with P(J) ~ exp( — J^). 
The crucial fact is that they are fixed and that they create a random frustration ]13[ |. 

Since this model cannot be solved (obviously) one studies its mean field version, the Sherrington 
Kirkpatrick model (SK). The sum defining the Hamiltonian runs now over all site couples of the 
lattice, i.e. D = oo: to make the infinite volume limit well defined the J variables have to scale now 
like 2 . Also the mean field theory is highly non-trivial. What is currently believed to be the 
correct solution of the model has been given by Parisi and relies on the mechanism of the so 
called Replica Symmetry Breaking 

The order parameter is the overlap q = '^^'''i configurations of the system in the 

same realization of the quenched disorder, J. For a given J we call Pj{q) the probability distribution 
of q, and by defining with a bar the average over the quenched disorder we call P{q) = Pj{q)- AH 
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the observables we will discuss in the following (like for example the susceptibility) will be similar 
to what we would study in the case of a normal spin model, substituting to the magnetization m 
the two replica overlap q. 

Parisi solution of the mean field theory of spin glasses has many new and remarkable features , 
that make it a new paradigm. Let us just quote in short some of the most relevant ones. A non-trivial 
equilibrium distribution of the order parameter denotes the existence of many states non related by 
a simple explicit symmetry. There is a complex free energy landscape (and all temperatures T 
smaller than the critical value Tc are critical) . There exist observable quantities (based on 2 or more 
replicas) that are non-self-averaging: macroscopic fluctuations survive in the infinite volume limit. 
The structure of equilibrium states is embedded with an ultrametric structure. The phase transition 
survives the presence of a finite magnetic field. It is also important to note that this picture, and 
the structure of Replica Symmetry Breaking, could be relevant to the description of glasses jisj : at 
least at the mean field level a complex pattern of frustration, even without quenched disorder, can 
be enough to put the system in a Parisi-like phase |l5| . 

Here we will discuss results from numerical simulations, done by using Monte Carlo and improved 
Monte Carlo methods 0] . Field theory is applied to the problem, and is starting to give interesting 
hints, but like for numerical simulations it is difficult to get reliable results too. We will quote 
here our main evidences, that we will discuss in some more detail later on, and we refer the reader 
to the original papers for more details. The 4D model (for example) turns out to behave very 
similarly to the mean field model (and, given some differences due to the vicinity of the lower critical 
dimension, also the 3-D model does)[[ This statement is quantitative: one finds for example very 
similar exponents for finite size corrections. I will recall here, in all generality, that since we are 
talking about numerical results, albeit well controlled, one is always dealing with finite volume, finite 
precision, results (with periodic boundary conditions in aU the following). 

There is a clear phase transition with as an order parameter the overlap q. One can determine 
critical exponents with good precision. The Pj{q) and P{q) that we have defined before turn out to 
be non-trivial, and we are able to control their infinite volume limit. 

The analysis of spatial correlation functions shows that the phase transition is mean field like: 
signatures of ultrametricity are clearly detected. Again, the behavior of finite D corrections in 4D, 
for example, is very similar to the one of the mean field solution. 



2 Existence of a Phase Transition 
2.1 The Binder Cumulant 

The simplest way to qualify the distribution probability of the order parameter is based on the use 
of the Binder cumulant 



(1) 



The shape of P{q) at Tc is universal, and = limi^oo Bl{Tc) is universal. In the warm phase the 
distribution probability of the order parameter is Gaussian and lim_L^oo Bl{T > Tc) — 0, while for 
ferromagnetic spin models in the cold phase lim_t_oo Bl{T > Tc) — 1 (here g is computed from m 
not from q). Curves of B{T) for different L values cross at Tc, giving a signature of the finite volume 
pseudo critical point. 

In the broken phase of the mean field SK spin glass g is not one for T < Tc. Here one 
can compute analytically that the non-trivial structure of P{q) implies that B{T < Tc) = | — 
^ J dP{q)q'^ /{ f dP{q)(f')^ . g is here in the broken phase a non-trivial function that is 1 at T = 0, 
has a minimum and tends to 1 when T — > Tc ■ 

In figure (0) (from ref. [^) the Binder cumulant for the AD model with binary couplings. L 
goes from 3 (lower curve for low T) to 10 (upper curve for low T) (we have L — 3,4,5,6,8,10). 
The crossing is very clear, and the critical point can be found with good precision: the quality of 
this evidence is comparable to the numerical evidence one has in the case of the usual ferromagnetic 
transition for the Ising model. A scaling plot of B{{T — Tc)L^^") shows a very good scaling with 
Tc = 2.04 and v = 0.91 (see for a detailed analysis including precise error bars on these numbers). 



^The upper critical dimension of the problem is 6. 
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Binder 4d +/- J 




Figure 1: Tlic Binder cumulant versus T. 



One finds tlie same liind of good scaling for tlie overlap susceptibility, and determines ||lO|] rj — —0.45 
and 7 — 0.23 (always in _D = 4). 

2.2 The P{q) 

It is interesting to discuss directly the shape of the probability distribution of the order parameter, 

In figure (B) (from ref. M) I show P{q) for the 3-D Ising spin glass with Gaussian couplings for 
different lattice sizes. Here T = 0.7, in the cold phase. Since we are interested in the infinite volume 
limit we have to look at what happens for increasing lattice size. There are two issues that need to 
be discussed. The first point is about the region of P{q) for small q: a non-zero probability means 
here that there are stable states with zero overlap. We notice that when increasing the lattice size 
the non-zero value of the plateau does not change (it would decrease if the transition would become 
of the ferromagnetic type, and it is shown in [^] that it does increase in a Kosterlitz-Thouless like 
transition). So, the constant value of the low q plateau is an indication of a non-trivial phase in the 
infinite volume limit. 

The second point is about the location of the peak, that should converge, in the infinite volume 
limit, to the value Edwards- Anderson value qsA flql. The location of the peak shifts strongly when 
increasing the lattice size (we know from a number of numerical experiments that finite size effects 
are very strong in spin glasses). It is essential to show that the location of the peak does not shift 
down to q — when L <x. 

This can be shown with high confidence level in 4D (and again quite clearly but with a larger 
uncertainty also in 3D ^). In figure (^ we show the location of the peak (for the 4D spin glass 
with binary couplings) at low T (in the broken phase) as a function of L~^'^ (the power is hinted by 
our best fit, see later). 

Already from figure (^ one would consider not plausible a null limiting value, but one has to be 
careful, and trying to keep the best fit under strict quantitative control. To be more clear one has 
to exclude, for example, that a fit of the form A/L" could work. This is usually quite tricky, since 
in a finite x range a small negative power mimics quite well a constant value with corrections given 
by a higher negative power. In 4_D even this evidence starts to be quite good one finds that 

qmax ~ 0.55 -I- 0.86L~^'^^ . This is a remarkable piece of quantitative agreement with the mean field 
theory: the analytic computation of ref. |^] gives for the mean field an exponent of 1.25 (that is 
very similar to the 1.31 we find in 4D). 

To end this section it is also interesting to note that more and more, when increasing L, the 
individual Pj{q) (for a given realization of the couplings) show a complex structure and many 
minima. For example |l^ the density of J configurations whose Pj{q) has 4 maxima goes from 0.1 
at L = 3 up to .35 for L = 8. 
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Figure 2: Probability distribution of the overlap P{q) for the 3D Ising spin glass with Gaussian couplings. 
Right to left L = 4,6, 8, 10 and 16 and T = 0.7. 
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Figure 3: Qmax versus L for the 4D Ising spin glass with binary couplings. 



4 



3 The Mean Field Picture 



3.1 Non Self-Averageness 

In the mean field picture one expects that sample to sample fluctuations of some observable quantities 
do not go to zero in the thermodynamic limit. We have shown numerically in ^ that for example 
sample to sample fiuctuations of {(f')j behave in the 3-D spin glass as one would expect for the mean 
field. In this same paper we have also noticed (and the same holds for the 4_D model) that the 
relation that had been obtained in Mean Field 

{q')j{q')j = lW)~j Wh + IWh , (2) 

holds with very good precision for the finite dimensional model. Guerra in ref. has shown 

that indeed this class of relations has to hold, also for finite dimensional models, under very general 
hypothesis. 



3.2 Correlation Functions and Block Overlap 

To establish the pattern of the symmetry breaking one wants to learn about the spatial structure of 
typical equilibrium configurations. We want to learn about the structure of typical spin domains. 

One way to study this problem is to look at spatial correlation functions. Mean field theory tells 
us that, as we have seen (and found also in the realistic models), the theory has an equilibrium q = 
sector. Here one expects a power behavior, i.e. the restricted q-q correlation functions behave as 

^X]<9"^"+^)l9=o ~ la;!"" . (3) 

i 

We have used a dynamic approach to compute these equilibrium correlation functions . We reach 
a good control, and we observe a clear power behavior. Recently we have confirmed this result with 
equilibrium simulations [^. 

The second check is based on defining the overlap of two configurations in boxes of linear size R, 
qR{x) = (Jx+yTx+y, whcrc J/ is a vector in a box, and checking how does this observable 

behave when R increases. In an ordinary scaling picture after reaching the typical size of a cluster 
(for R — » oo, R <^ L) the distribution probability of qj{, PR{qR), should peak in two (5-functions 
at itqEA- On the contrary in the mean field approach one expects the Pr to stay Gaussian on all 
scales. In our numerical simulations we always observe a clear mean field like behavior. 



3.3 Ultrametricity 

Ultrametricity is a crucial feature of the Parisi solution (see for example [|l^). States appearing in 
the Parisi solution of the Mean Field SK theory are organized according to an ultrametric structure: 
if we define a distance among two configurations d{a, /3) the usual triangular inequality d{a, 7) < 
d{a,/3) + d(/3,7) is substituted by the stronger inequality d{a,'y) < max{d(a, d(/3, 7)}, i.e. all 
triangles have two equal sides longer or equal to the third one. This is the structure one finds when 
considering, for example a hierarchical tree. One possible definition for the distance of two spin 
configurations is 

d(a,/3)..2^f^. (4) 
2qEA 

To study this issue (in 4_D with binary coupling) we have used a constrained Monte Carlo 
procedure. We simulate 3 copies of the system, with the same couplings, and we constrain 2 of 
the 3 overlap to be fix 

g(a,/3) =g(/3,7) =g (5) 
(in the actual numerical simulation we let q vary over a small range). We measure then 5(0,7). 

Again, the results of the simulation are not distinguishable from the ones one gets for the SK 
model, and contains strong hints towards the presence of an ultrametric structure. For example we 
can give a measure of the amount of equilibrium configurations that are not ultrametric by defining 

Il = f (qL ~qfP{qL)dqL + j [qL - qsAf P{qL)dqL , (6) 
J-i JqEA 
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that we expect to go to zero, for L — > oo, if the states have an uhrametric structure. We find that 
II has a very clear power behavior, i.e. Il ~ ( — 1 ± 5)10~* + (.76± .03)/L^'^'^**' '^* (where the errors 
are only statistical). This is again a remarkable agreement with mean field predictions, since from 
ref. [J16| one would expect a value of 8/3 for the mean field theory. 



4 Conclusions 

Numerical simulations show that the behavior of finite dimensional spin glasses is very similar to the 
one of the Parisi solution of mean field theory. Together with a qualitative evidence (including the 
behavior of P{q) and the correlation function) there is some striking quantitative evidence, involving 
the value of exponents determining finite size corrections. It is maybe worth noticing that where 
the numerical evidence is not very strong (because of finite size effects or because of the difficulty of 
thermalizing the system deep in the cold phase) this is true also for actual simulations of the mean 
field theory. There is, as usual, space for improvements. 
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